Requirement already satisfied: plotly in ./venv/lib/python3.10/site-packages (5.13.0)
Requirement already satisfied: tenacity>=6.2.0 in ./venv/lib/python3.10/site-packages (from plotly) (8.1.0)

[notice] A new release of pip available: 22.2.2 -> 23.0.1
[notice] To update, run: pip install --upgrade pip
Requirement already satisfied: folium in ./venv/lib/python3.10/site-packages (0.14.0)
Requirement already satisfied: branca>=0.6.0 in ./venv/lib/python3.10/site-packages (from folium) (0.6.0)
Requirement already satisfied: numpy in ./venv/lib/python3.10/site-packages (from folium) (1.24.1)
Requirement already satisfied: requests in ./venv/lib/python3.10/site-packages (from folium) (2.28.2)
Requirement already satisfied: jinja2>=2.9 in ./venv/lib/python3.10/site-packages (from folium) (3.1.2)
Requirement already satisfied: MarkupSafe>=2.0 in ./venv/lib/python3.10/site-packages (from jinja2>=2.9->folium) (2.1.2)
Requirement already satisfied: charset-normalizer<4,>=2 in ./venv/lib/python3.10/site-packages (from requests->folium) (3.0.1)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in ./venv/lib/python3.10/site-packages (from requests->folium) (1.26.14)
Requirement already satisfied: idna<4,>=2.5 in ./venv/lib/python3.10/site-packages (from requests->folium) (3.4)
Requirement already satisfied: certifi>=2017.4.17 in ./venv/lib/python3.10/site-packages (from requests->folium) (2022.12.7)

[notice] A new release of pip available: 22.2.2 -> 23.0.1
[notice] To update, run: pip install --upgrade pip
Requirement already satisfied: mlxtend in ./venv/lib/python3.10/site-packages (0.21.0)
Requirement already satisfied: joblib>=0.13.2 in ./venv/lib/python3.10/site-packages (from mlxtend) (1.2.0)
Requirement already satisfied: matplotlib>=3.0.0 in ./venv/lib/python3.10/site-packages (from mlxtend) (3.6.3)
Requirement already satisfied: scikit-learn>=1.0.2 in ./venv/lib/python3.10/site-packages (from mlxtend) (1.2.1)
Requirement already satisfied: numpy>=1.16.2 in ./venv/lib/python3.10/site-packages (from mlxtend) (1.24.1)
Requirement already satisfied: pandas>=0.24.2 in ./venv/lib/python3.10/site-packages (from mlxtend) (1.5.3)
Requirement already satisfied: setuptools in ./venv/lib/python3.10/site-packages (from mlxtend) (63.2.0)
Requirement already satisfied: scipy>=1.2.1 in ./venv/lib/python3.10/site-packages (from mlxtend) (1.10.0)
Requirement already satisfied: packaging>=20.0 in ./venv/lib/python3.10/site-packages (from matplotlib>=3.0.0->mlxtend) (23.0)
Requirement already satisfied: pyparsing>=2.2.1 in ./venv/lib/python3.10/site-packages (from matplotlib>=3.0.0->mlxtend) (3.0.9)
Requirement already satisfied: kiwisolver>=1.0.1 in ./venv/lib/python3.10/site-packages (from matplotlib>=3.0.0->mlxtend) (1.4.4)
Requirement already satisfied: contourpy>=1.0.1 in ./venv/lib/python3.10/site-packages (from matplotlib>=3.0.0->mlxtend) (1.0.7)
Requirement already satisfied: python-dateutil>=2.7 in ./venv/lib/python3.10/site-packages (from matplotlib>=3.0.0->mlxtend) (2.8.2)
Requirement already satisfied: pillow>=6.2.0 in ./venv/lib/python3.10/site-packages (from matplotlib>=3.0.0->mlxtend) (9.4.0)
Requirement already satisfied: fonttools>=4.22.0 in ./venv/lib/python3.10/site-packages (from matplotlib>=3.0.0->mlxtend) (4.38.0)
Requirement already satisfied: cycler>=0.10 in ./venv/lib/python3.10/site-packages (from matplotlib>=3.0.0->mlxtend) (0.11.0)
Requirement already satisfied: pytz>=2020.1 in ./venv/lib/python3.10/site-packages (from pandas>=0.24.2->mlxtend) (2022.7.1)
Requirement already satisfied: threadpoolctl>=2.0.0 in ./venv/lib/python3.10/site-packages (from scikit-learn>=1.0.2->mlxtend) (3.1.0)
Requirement already satisfied: six>=1.5 in ./venv/lib/python3.10/site-packages (from python-dateutil>=2.7->matplotlib>=3.0.0->mlxtend) (1.16.0)

[notice] A new release of pip available: 22.2.2 -> 23.0.1
[notice] To update, run: pip install --upgrade pip
Out[4]:
Unnamed: 0 InvoiceNo StockCode Description Quantity InvoiceDate UnitPrice CustomerID Country len
0 0 536365 85123A WHITE HANGING HEART T-LIGHT HOLDER 6 2010-12-01 08:26:00 2.55 17850.0 United Kingdom 34
1 1 536365 71053 WHITE METAL LANTERN 6 2010-12-01 08:26:00 3.39 17850.0 United Kingdom 19
2 2 536365 84406B CREAM CUPID HEARTS COAT HANGER 8 2010-12-01 08:26:00 2.75 17850.0 United Kingdom 30
3 3 536365 84029G KNITTED UNION FLAG HOT WATER BOTTLE 6 2010-12-01 08:26:00 3.39 17850.0 United Kingdom 35
4 4 536365 84029E RED WOOLLY HOTTIE WHITE HEART. 6 2010-12-01 08:26:00 3.39 17850.0 United Kingdom 30
... ... ... ... ... ... ... ... ... ... ...
244420 245898 558637 22032 BOTANICAL LILY GREETING CARD 12 2011-06-30 20:07:00 0.42 17891.0 United Kingdom 28
244421 245899 558637 22028 PENNY FARTHING BIRTHDAY CARD 12 2011-06-30 20:07:00 0.42 17891.0 United Kingdom 28
244422 245900 558637 22033 BOTANICAL ROSE GREETING CARD 12 2011-06-30 20:07:00 0.42 17891.0 United Kingdom 28
244423 245901 558637 22029 SPACEBOY BIRTHDAY CARD 12 2011-06-30 20:07:00 0.42 17891.0 United Kingdom 22
244424 245902 558637 22024 RAINY LADIES BIRTHDAY CARD 12 2011-06-30 20:07:00 0.42 17891.0 United Kingdom 26

244425 rows × 10 columns

Out[5]:
Unnamed: 0 InvoiceNo StockCode Description Quantity InvoiceDate UnitPrice CustomerID Country len
0 0 536365 85123A WHITE HANGING HEART T-LIGHT HOLDER 6 2010-12-01 08:26:00 2.55 17850.0 United Kingdom 34
1 1 536365 71053 WHITE METAL LANTERN 6 2010-12-01 08:26:00 3.39 17850.0 United Kingdom 19
2 2 536365 84406B CREAM CUPID HEARTS COAT HANGER 8 2010-12-01 08:26:00 2.75 17850.0 United Kingdom 30
3 3 536365 84029G KNITTED UNION FLAG HOT WATER BOTTLE 6 2010-12-01 08:26:00 3.39 17850.0 United Kingdom 35
4 4 536365 84029E RED WOOLLY HOTTIE WHITE HEART. 6 2010-12-01 08:26:00 3.39 17850.0 United Kingdom 30
Out[6]:
Unnamed: 0 Quantity UnitPrice CustomerID len
count 244425.000000 244425.000000 244425.000000 176876.000000 244425.000000
mean 122924.629522 9.699675 5.125403 15282.690099 26.490658
std 70997.604797 216.997497 118.936361 1723.746421 5.462467
min 0.000000 -74215.000000 0.001000 12346.000000 6.000000
25% 61436.000000 1.000000 1.250000 13862.000000 23.000000
50% 122827.000000 3.000000 2.100000 15146.000000 27.000000
75% 184443.000000 10.000000 4.210000 16816.250000 31.000000
max 245902.000000 74215.000000 38970.000000 18287.000000 35.000000 
Check if we had negative quantity and prices at same register: No 

Check how many register we have where quantity is negative and prices is 0 or vice-versa: 0

What is the customer ID of the registers above: []

% Negative Quantity: 1.84%

All register with negative quantity has Invoice start with: ['C']

See an example of negative quantity and others related records:
Unnamed: 0 InvoiceNo StockCode Description Quantity InvoiceDate UnitPrice CustomerID Country len
2 2 536365 84406B CREAM CUPID HEARTS COAT HANGER 8 2010-12-01 08:26:00 2.75 17850.0 United Kingdom 30
51 51 536373 84406B CREAM CUPID HEARTS COAT HANGER 8 2010-12-01 09:01:00 2.75 17850.0 United Kingdom 30
68 68 536375 84406B CREAM CUPID HEARTS COAT HANGER 8 2010-12-01 09:31:00 2.75 17850.0 United Kingdom 30
280 280 536396 84406B CREAM CUPID HEARTS COAT HANGER 8 2010-12-01 10:50:00 2.75 17850.0 United Kingdom 30
418 418 536406 84406B CREAM CUPID HEARTS COAT HANGER 8 2010-12-01 11:32:00 2.75 17850.0 United Kingdom 30
3184 3194 536609 84406B CREAM CUPID HEARTS COAT HANGER 6 2010-12-02 09:40:00 2.75 17850.0 United Kingdom 30
3216 3226 536612 84406B CREAM CUPID HEARTS COAT HANGER 6 2010-12-02 09:43:00 2.75 17850.0 United Kingdom 30
3417 3427 536628 84406B CREAM CUPID HEARTS COAT HANGER 6 2010-12-02 10:54:00 2.75 17850.0 United Kingdom 30
3435 3445 536630 84406B CREAM CUPID HEARTS COAT HANGER 6 2010-12-02 10:56:00 2.75 17850.0 United Kingdom 30
3800 3810 536685 84406B CREAM CUPID HEARTS COAT HANGER 6 2010-12-02 12:23:00 2.75 17850.0 United Kingdom 30
3815 3825 536690 84406B CREAM CUPID HEARTS COAT HANGER 6 2010-12-02 12:24:00 2.75 17850.0 United Kingdom 30
4153 4163 536750 84406B CREAM CUPID HEARTS COAT HANGER 6 2010-12-02 14:03:00 2.75 17850.0 United Kingdom 30
4174 4184 536752 84406B CREAM CUPID HEARTS COAT HANGER 6 2010-12-02 14:06:00 2.75 17850.0 United Kingdom 30
4500 4512 536787 84406B CREAM CUPID HEARTS COAT HANGER 8 2010-12-02 15:24:00 2.75 17850.0 United Kingdom 30
4516 4528 536790 84406B CREAM CUPID HEARTS COAT HANGER 12 2010-12-02 15:26:00 2.75 17850.0 United Kingdom 30
Out[10]:
Unnamed: 0              int64
InvoiceNo              object
StockCode              object
Description            object
Quantity                int64
InvoiceDate    datetime64[ns]
UnitPrice             float64
CustomerID              Int64
Country                object
len                     int64
amount                float64
Internal               object
dtype: object
Out[11]:
Description total_count
3384 WHITE HANGING HEART T-LIGHT HOLDER 1337
2593 REGENCY CAKESTAND 3 TIER 1267
1658 JUMBO BAG RED RETROSPOT 1046
2180 PARTY BUNTING 1012
1817 LUNCH BAG RED RETROSPOT 829
... ... ...
3361 WHITE ANEMONE ARTIFICIAL FLOWER 1
1094 ETCHED GLASS STAR TREE DECORATION 1
2249 PINK ALLIUM ARTIFICIAL FLOWER 1
327 BLACK CHRISTMAS FLOCK DROPLET 1
1963 MOROCCAN BEATEN METAL DISH 1

3541 rows × 2 columns

/home/ayush/Documents/Project/ayush/customer_segm_RFM/venv/lib/python3.10/site-packages/plotly/io/_renderers.py:395: DeprecationWarning:

distutils Version classes are deprecated. Use packaging.version instead.

/home/ayush/Documents/Project/ayush/customer_segm_RFM/venv/lib/python3.10/site-packages/plotly/io/_renderers.py:395: DeprecationWarning:

distutils Version classes are deprecated. Use packaging.version instead.
Out[13]:
Unnamed: 0 InvoiceNo StockCode Description Quantity InvoiceDate UnitPrice CustomerID Country len amount Internal
0 0 536365 85123A WHITE HANGING HEART T-LIGHT HOLDER 6 2010-12-01 08:26:00 2.55 17850 United Kingdom 34 15.30 Yes
1 1 536365 71053 WHITE METAL LANTERN 6 2010-12-01 08:26:00 3.39 17850 United Kingdom 19 20.34 Yes
2 2 536365 84406B CREAM CUPID HEARTS COAT HANGER 8 2010-12-01 08:26:00 2.75 17850 United Kingdom 30 22.00 Yes
3 3 536365 84029G KNITTED UNION FLAG HOT WATER BOTTLE 6 2010-12-01 08:26:00 3.39 17850 United Kingdom 35 20.34 Yes
4 4 536365 84029E RED WOOLLY HOTTIE WHITE HEART. 6 2010-12-01 08:26:00 3.39 17850 United Kingdom 30 20.34 Yes 
Total rows having negative quantity = 4494
Total rows having not less than 1 quantity = 239931
Total rows which will be using for further analysis = 239931
Out[16]:
Description amount
2583 REGENCY CAKESTAND 3 TIER 107256.36
981 DOTCOM POSTAGE 90096.63
1855 MEDIUM CERAMIC TOP STORAGE JAR 78548.05
3369 WHITE HANGING HEART T-LIGHT HOLDER 63388.92
2172 PARTY BUNTING 59454.31
1650 JUMBO BAG RED RETROSPOT 44051.21
2432 POSTAGE 40377.18
2217 PICNIC BASKET WICKER 60 PIECES 39619.50
1982 Manual 32308.60
200 ASSORTED COLOUR BIRD ORNAMENT 25799.51
Out[23]:
InvoiceNo 0
0 536365 7
1 536366 2
2 536367 12
3 536368 4
4 536369 1
... ... ...
9654 558633 14
9655 558634 16
9656 558635 14
9657 558636 17
9658 558637 34

9659 rows × 2 columns

Out[24]:
Description 4 PURPLE FLOCK DINNER CANDLES OVAL WALL MIRROR DIAMANTE SET 2 TEA TOWELS I LOVE LONDON SPACEBOY BABY GIFT SET TOADSTOOL BEDSIDE LIGHT *Boombox Ipod Classic *USB Office Mirror Ball 10 COLOUR SPACEBOY PEN 12 COLOURED PARTY BALLOONS 12 DAISY PEGS IN WOOD BOX ... ZINC STAR T-LIGHT HOLDER ZINC SWEETHEART SOAP DISH ZINC SWEETHEART WIRE LETTER RACK ZINC T-LIGHT HOLDER STAR LARGE ZINC T-LIGHT HOLDER STARS LARGE ZINC T-LIGHT HOLDER STARS SMALL ZINC TOP 2 DOOR WOODEN SHELF ZINC WILLIE WINKIE CANDLE STICK ZINC WIRE KITCHEN ORGANISER ZINC WIRE SWEETHEART LETTER TRAY
InvoiceNo
536365 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 ... 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0
536366 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 ... 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0
536367 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 ... 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0
536368 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 ... 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0
536369 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 ... 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0

5 rows × 3525 columns

Out[25]:
Description 4 PURPLE FLOCK DINNER CANDLES OVAL WALL MIRROR DIAMANTE SET 2 TEA TOWELS I LOVE LONDON SPACEBOY BABY GIFT SET TOADSTOOL BEDSIDE LIGHT *Boombox Ipod Classic *USB Office Mirror Ball 10 COLOUR SPACEBOY PEN 12 COLOURED PARTY BALLOONS 12 DAISY PEGS IN WOOD BOX ... ZINC STAR T-LIGHT HOLDER ZINC SWEETHEART SOAP DISH ZINC SWEETHEART WIRE LETTER RACK ZINC T-LIGHT HOLDER STAR LARGE ZINC T-LIGHT HOLDER STARS LARGE ZINC T-LIGHT HOLDER STARS SMALL ZINC TOP 2 DOOR WOODEN SHELF ZINC WILLIE WINKIE CANDLE STICK ZINC WIRE KITCHEN ORGANISER ZINC WIRE SWEETHEART LETTER TRAY
InvoiceNo
536365 0 0 0 0 0 0 0 0 0 0 ... 0 0 0 0 0 0 0 0 0 0
536366 0 0 0 0 0 0 0 0 0 0 ... 0 0 0 0 0 0 0 0 0 0
536367 0 0 0 0 0 0 0 0 0 0 ... 0 0 0 0 0 0 0 0 0 0
536368 0 0 0 0 0 0 0 0 0 0 ... 0 0 0 0 0 0 0 0 0 0
536369 0 0 0 0 0 0 0 0 0 0 ... 0 0 0 0 0 0 0 0 0 0

5 rows × 3525 columns

Total number of baskets used for analysis= 9659
The minimum support value for the analysis is  3.1059 %

/home/ayush/Documents/Project/ayush/customer_segm_RFM/venv/lib/python3.10/site-packages/mlxtend/frequent_patterns/fpcommon.py:111: DeprecationWarning:

DataFrames with non-bool types result in worse computationalperformance and their support might be discontinued in the future.Please use a DataFrame with bool type
Out[27]:
support
count 129.000000
mean 0.046378
std 0.016664
min 0.031059
25% 0.035407
50% 0.041205
75% 0.050626
max 0.132415
Out[28]:
antecedents consequents antecedent support consequent support support confidence lift leverage conviction
10 (PINK REGENCY TEACUP AND SAUCER) (GREEN REGENCY TEACUP AND SAUCER) 0.039652 0.059323 0.032923 0.830287 13.996063 0.030570 5.542759
12 (PINK REGENCY TEACUP AND SAUCER) (ROSES REGENCY TEACUP AND SAUCER ) 0.039652 0.061601 0.031370 0.791123 12.842780 0.028927 4.492587
9 (GREEN REGENCY TEACUP AND SAUCER) (ROSES REGENCY TEACUP AND SAUCER ) 0.059323 0.061601 0.045036 0.759162 12.323947 0.041381 3.896398
8 (ROSES REGENCY TEACUP AND SAUCER ) (GREEN REGENCY TEACUP AND SAUCER) 0.061601 0.059323 0.045036 0.731092 12.323947 0.041381 3.498143
0 (JUMBO BAG PINK POLKADOT) (JUMBO BAG RED RETROSPOT) 0.064914 0.105705 0.044000 0.677831 6.412506 0.037139 2.775858
5 (JUMBO BAG BAROQUE BLACK WHITE) (JUMBO BAG RED RETROSPOT) 0.052593 0.105705 0.033647 0.639764 6.052378 0.028088 2.482525
3 (JUMBO STORAGE BAG SUKI) (JUMBO BAG RED RETROSPOT) 0.064603 0.105705 0.038513 0.596154 5.639814 0.031684 2.214446
7 (JUMBO SHOPPER VINTAGE RED PAISLEY) (JUMBO BAG RED RETROSPOT) 0.062739 0.105705 0.036857 0.587459 5.557555 0.030225 2.167772
11 (GREEN REGENCY TEACUP AND SAUCER) (PINK REGENCY TEACUP AND SAUCER) 0.059323 0.039652 0.032923 0.554974 13.996063 0.030570 2.157958
13 (ROSES REGENCY TEACUP AND SAUCER ) (PINK REGENCY TEACUP AND SAUCER) 0.061601 0.039652 0.031370 0.509244 12.842780 0.028927 1.956873 
/home/ayush/Documents/Project/ayush/customer_segm_RFM/venv/lib/python3.10/site-packages/plotly/io/_renderers.py:395: DeprecationWarning:

distutils Version classes are deprecated. Use packaging.version instead.

/home/ayush/Documents/Project/ayush/customer_segm_RFM/venv/lib/python3.10/site-packages/plotly/io/_renderers.py:395: DeprecationWarning:

distutils Version classes are deprecated. Use packaging.version instead.


/home/ayush/Documents/Project/ayush/customer_segm_RFM/venv/lib/python3.10/site-packages/plotly/io/_renderers.py:395: DeprecationWarning:

distutils Version classes are deprecated. Use packaging.version instead.

/home/ayush/Documents/Project/ayush/customer_segm_RFM/venv/lib/python3.10/site-packages/plotly/io/_renderers.py:395: DeprecationWarning:

distutils Version classes are deprecated. Use packaging.version instead.


/home/ayush/Documents/Project/ayush/customer_segm_RFM/venv/lib/python3.10/site-packages/plotly/io/_renderers.py:395: DeprecationWarning:

distutils Version classes are deprecated. Use packaging.version instead.

/home/ayush/Documents/Project/ayush/customer_segm_RFM/venv/lib/python3.10/site-packages/plotly/io/_renderers.py:395: DeprecationWarning:

distutils Version classes are deprecated. Use packaging.version instead.
Out[33]:
antecedents consequents antecedent support consequent support support confidence lift leverage conviction
10 (PINK REGENCY TEACUP AND SAUCER) (GREEN REGENCY TEACUP AND SAUCER) 0.039652 0.059323 0.032923 0.830287 13.996063 0.030570 5.542759
12 (PINK REGENCY TEACUP AND SAUCER) (ROSES REGENCY TEACUP AND SAUCER ) 0.039652 0.061601 0.031370 0.791123 12.842780 0.028927 4.492587
9 (GREEN REGENCY TEACUP AND SAUCER) (ROSES REGENCY TEACUP AND SAUCER ) 0.059323 0.061601 0.045036 0.759162 12.323947 0.041381 3.896398
8 (ROSES REGENCY TEACUP AND SAUCER ) (GREEN REGENCY TEACUP AND SAUCER) 0.061601 0.059323 0.045036 0.731092 12.323947 0.041381 3.498143
11 (GREEN REGENCY TEACUP AND SAUCER) (PINK REGENCY TEACUP AND SAUCER) 0.059323 0.039652 0.032923 0.554974 13.996063 0.030570 2.157958
13 (ROSES REGENCY TEACUP AND SAUCER ) (PINK REGENCY TEACUP AND SAUCER) 0.061601 0.039652 0.031370 0.509244 12.842780 0.028927 1.956873